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A METHOD AND A SYSTEM FOR ENABLING DATA TO BE STORED IN A 
COMPUTER NETWORK; A METHOD AND A SYSTEM FOR STORING DATA IN A 
COMPUTER NETWORK 

5 [0001] This invention relates to a method and a system for 
enabling data to be stored in a computer network, and also a 
method and a system for storing data in the computer network. 

Background of the Invention 

10 

[0002] A computer network is normally used as a transport 
mechanism whereby data are transmitted from one node to 
another through physical network interconnecting the nodes. 
The computer network usually comprises a plurality of 

15 computer nodes which are implemented using computers, 
routers, network hubs, etc. These computer nodes are 
connected to one another, enabling data to be transferred 
from one node to another. The transmission of the data in 
the network is controlled using network protocols implemented 

20 on the computer nodes supporting a routing and a signaling 
framework. 

[0003] The routing framework which can be implemented by 
running routing protocols, such as Open Shortest-Path-First 

25 (OSPF) or Intermediate-Systems to Intermediate-System (IS-IS) 
as disclosed in [1] and [2], provides information on the 
topology and resource availability of the nodes. The 
signaling framework which can be implemented by running 
signaling protocols, such as Label-Distributed Protocol (LDP) 

30 or Resource Reservation Protocol (RSVP) as disclosed in [3] 
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and [4], establishes the forwarding path of the data based on 
the information obtained from the routing framework. 

[0004] Multi-Protocol Label Switching (MPLS) (see [5] and 
5 [6]) has been used as a control plane on computer nodes to 
control the forwarding of the data along the forwarding paths 
established in the network based on the routing and signaling 
protocols. Normally, data is forwarded in the form of data 
packets based on the content of the data packet headers. The 
10 data packets are partitioned into sets of Forwarding 

Equivalence Classes (FECs), and each FEC is mapped to a next 
hop (node) in the network along the established paths. 

[0005] In MPLS, the FEC assigned to each data packet is 
15 encoded as a short fixed length value known as "label" and is 
forwarded together with the data packet to the next hop. At 
subsequent hops, the label is used as an index into a table 
at each node to find the next hop. The label is replaced 
with a new label and the data packet is forwarded to another 
20 next hop based on the new label. In MPLS, the path taken by 
the data packet through a series of nodes to a destination 
node is known as the Label Switched Path (LSP) . 

[0006] Attempts have been made by many researchers to 
25 persist/store data in computer networks. However, such 
attempts to store data in the computer network are only 
implemented by storing the data in the computing nodes 
themselves or in a memory unit of a computer connected to a 
node in the network. When a large number of nodes want to 
30 read the data which is stored in the computer nodes, a number 
of point-to-point connections need to be established to 
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deliver the requested data from these computer nodes to the 
nodes requesting such data. However , this causes congestion 
in the network, and hence renders the process inefficient. 

5 [0007] CANARIE Inc. has developed a concept of Wavelength 
Disk Drives (WDD) for storing data in a wide scale multi- 
wavelength Dense Wave Division Multiplexing (DWDM) system as 
disclosed in [7] . The purpose of the WDD is to allow a 
single application to harness the computing power of 

10 processors in different computers which are connected in a 

network. However, the WDD is implemented on the transport or 
application layer of the computer network. This means the 
processing overheads at every node is high, as additional 
headers need to be processed for each packet. Also, CANARIE' s 

15 scheme does not allow the network resources to be partitioned 
easily for storage and transport. This results in poor 
bandwidth resource allocation in the WDD network, and hence, 
its use as a storage system will affect the normal data 
transportation function . 

20 

[0008] Thus, it is desirable to be able to store data in a 
computer network in such a way that the available network 
resources are utilized efficiently. 

25 Summary of the Invention 

[0009] The invention is provided with a method for enabling 
data to be stored in a network comprising a plurality of 
computer nodes according to the features of the independent 
30 claims. Preferred embodiments of the invention are defined 
in the dependent claims. 
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[0010] The method according to the invention is implemented 
in a computer network comprising a plurality of computer 
nodes, wherein each computer node comprises at least one 
5 connection oriented link layer unit. The method for enabling 
the storage of data in the network comprises the step of 
defining a looping path in the computer network, wherein the 
looping path comprises a plurality of computer nodes and 
connections between the computer nodes, and configuring a 

10 connection unit at each node along the looping path, the 
connection unit being supported by the connection oriented 
link layer unit, such that the connection oriented link layer 
unit at each computer node is able to send incoming data 
which is to be stored in the computer network to a next 

15 computer node along the looping path based on the connection 
unit, thereby providing the looping path for data to be 
circulated in, and thereby enabling the storage of data in 
the computer network. 

20 [0011] According to the invention, a connection oriented link 
layer (COLL) unit is used for controlling the forwarding of 
data at each computer node of the computer network. The COLL 
unit is a connection oriented service implemented at the data 
forwarding plane, which is between layers 1 and 3 of the OSI 

25 model on each of the computer nodes of the computer network. 
The COLL unit sends data from a source node by establishing a 
connection with the COLL unit of the destination node and 
setting up a virtual path, wherein data are sent to the 
destination node using this virtual path. 

30 
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[0012] The setting up of the looping path in the computer 
network for data storage involves a first step of using the 
COLL unit to define the path wherein data is to be stored. 
The path comprises a series of computer nodes wherein the 
first node along the path is also the last node of the same 
path, so that data are made to loop in the path, and hence 
can be stored in it. 

[0013] Each computer node comprises a configurable connection 
unit which specifies how incoming data arriving at the 
computer node is to be handled. According to a second step 
of the invention, the connection unit at each computer node 
along the defined looping path is configured such that 
incoming data arriving at the computer node from a previous 
node along the looping path is switched out to the next node 
along the looping path. 

[0014] The switching of data at each computer node is 
performed by the COLL unit, onto which the connection unit is 
supported. Specifically, the COLL unit at each computer node 
receives the incoming data, and based on the configuration of 
the connection unit, switches them as outgoing data to the 
next computer node specified by the connection unit. 
Therefore, data can be stored in the computer network by 
being circulated in the looping path. 

[0015] The method according to the invention allows wide-area 
storage devices like giant-sized disks or shared memory for 
Inter-Processor Communications to be implemented. The data 
stored in the network can thus be utilized by applications or 
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computers connected to the computer nodes which may be 
thousands of kilometers apart. 

[0016] The storing of data in looping paths in the computer 
5 network according to the invention also allows fast access of 
the stored data by the computers or applications at the 
computer nodes. This is because applications at computer 
nodes can read data directly from the network instead of 
reading the data from another computer or memory unit 
10 attached to another computer node, thus eliminating the slow 
point-to-point communication between the computer nodes. 

[0017] Also, since the method according to the invention 
creates an entity in the control plane of the computer 

15 network called a switched path wherein the switched path is 
uniquely identified and can be easily managed by protocols of 
the control plane, this switched path is easily configurable 
in terms of bandwidth resources. Hence, the network can be 
partitioned in terms of resources for storing data in the 

20 looping path, and for normal transportation of data in other 
parts of the same network. For example, an administrator is 
able to reserve some bandwidth in the network for the looping 
path. When demand for normal transportation in the computer 
network is high, the amount of bandwidth reserved for the 

25 looping path can be changed accordingly. In addition, a high 
priority level may also be set for the looping path that 
allows the looping path to be kept intact even in the event 
that the demand for normal transportation of data is high. 
On the other hand, priority for the looping path can be 

30 lowered to allow normal transportation of data to have 
additional bandwidth. 
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[0018] It should be noted that the method according to the 
invention can be implemented on computer nodes of the 
computer network using existing network protocols, and does 
5 not require any specialized hardware. The method according 
to the invention is also not restricted to any network 
topologies, and can be implemented onto the nodes of the 
computer network having a ring topology, a mesh topology or 
star-shaped topology. 

10 

[0019] The COLL unit may be implemented using any protocols 
which support connection oriented services (see [8]) like 
Asynchronous Transfer Mode (ATM) , Frame-Relay, Multi-protocol 
Label Switching (MPLS), etc. 

15 

[0020] According to a preferred embodiment of the invention, 
the COLL unit is implemented according to a generalized MPLS 
specification. The generalized MPLS supports not only the 
switching of data packets at each computer node, but also 

20 supports lambda switching, fiber switching and time-division 
multiplexing in a computer network which connects the 
computer nodes using optical fibers. In other words, the 
COLL unit (or the control plane) based on the generalized 
MPLS implemented on each computer nodes does not only make 

25 forwarding or switching decisions of data based on the label 
of each incoming data packet, but can also make such 
decisions based on wavelengths, physical ports or time slots. 

[0021] In a preferred embodiment of the invention, the COLL 
30 unit at each computer node supports a signaling framework, 
which framework is implemented by running a signaling 
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protocol on the nodes. In this embodiment, the signaling 
protocol running on the nodes may be implemented using the 
Label Distribution Protocol (LDP) or Resource Reservation 
Protocol (RSVP) . The signaling protocol is also preferably 
used to configure the connection unit at each node of the 
defined looping path to set up the looping path. 

[0022] Therefore, the setting up of the looping path can be 
performed automatically using the signaling protocol 
implemented on each computer node without requiring the 
administrator to configure each connection unit at every node 
of the looping path, using node-specific or other types of 
programmatic interfaces. This automatic setting up of the 
looping path using signaling protocol can save a lot of time 
and effort for the network administrator, especially when the 
looping path comprises many nodes. 

[0023] In this preferred embodiment of the invention, the 
connection unit at each node along the looping path is 
configured by a signaling message generated by the signaling 
protocol running on each of the nodes of the looping path. 
The signaling message contains essential information for 
setting the essential attributes in the connection unit in 
order to set up the defined looping path. 

[0024] According to the invention, an attribute of the 
connection unit at each computer node is set to a predefined 
value, so that the looping path can be identified and 
differentiated from a normal path by testing the value of the 
said attribute. This allows the COLL unit to process data in 
the looping path differently from normal data. 
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[0025] The attribute of the connection unit may be set by the 
administrator through a programmatic interface at each 
computer node along the looping path in an alternative 
5 embodiment. However in the preferred embodiment of the 

invention, the attribute of the connection unit is set by the 
signaling message from the signaling protocol running on the 
computer nodes. The advantage of setting the attribute of 
the connection unit by the signaling message is that the 
10 attribute of the connection unit at each node of the looping 
path can be set automatically without having to configure 
each node manually by the administrator as mentioned above. 

[0026] The method for enabling the storage of data in the 
15 computer network further comprises the steps of identifying 
the looping path based on an attribute of the signaling 
message, and preventing the identified looping path from 
being aborted by the signaling protocol running on the 
computer nodes of the computer network. 

20 

[0027] This attribute of the signaling message is used to 
identify the looping path by setting the said attribute to a 
predefined value. The said attribute of the signaling 
message when sent to a computer node in the looping path is 
25 read by the COLL unit of the node, which then updates the 
attribute in the connection unit to identify the path 
signaled by the signaling message as a looping path. 

[0028] Looping paths are normally undesirable in the computer 
30 network as they consume valuable bandwidth in the network. 
Therefore, most signaling protocols running on the computer 
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nodes have mechanisms to detect looping paths and abort them. 
Thus the invention also further ensures that the creation 
process of the looping path is not aborted by the loop 
detection mechanisms of the signaling protocol, so that data 
5 can be stored or circulated in the created looping path for a 
configurable amount of time. However for normal data which 
is not intended to be stored in the looping path, the loop 
detection mechanisms are still needed to detect if the paths 
for these normal data are looping, and abort them 
10 accordingly. 

[0029] In a preferred embodiment of the invention, a further 
attribute of the signaling message having a value which is 
being incremented at each computer node along the looping 
15 path is set to a predefined value at at least a predefined 
computer node along the path of the looping path. 

[0030] Signaling messages from signaling protocols, such as 
LDP, has a further attribute with a value which is being 

20 incremented at every node along the looping path. This 

further attribute is normally used by the signaling protocols 
to detect looping paths. When the value of this further 
attribute exceeds a threshold value, the path to be set up by 
the signaling protocol is deemed to be looping, and the 

25 process of setting up the path defined in the signaling 
message is aborted. Thus by setting the value of this 
attribute to a predefined value, the value of this further 
attribute will not exceed the threshold value, and hence the 
setting up of the looping path will not be aborted by the 

30 signaling protocol. 

10 
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[0031] In another preferred embodiment of the invention, 
another further attribute of the signaling message having a 
node identifier of each computer node being added to it at 
the respective computer node of the looping path is set to a 
5 predefined value at at least a predefined node along the 
looping path. 

[0032] Signaling messages from signaling protocols, such as 
LDP or RSVP, also have an attribute with a value which is the 

10 result of the node identifier of each node along the looping 
path being appended to it. When the length of this attribute 
becomes too long such that it exceeds a threshold length, the 
signaling protocol interprets that the path is looping, and 
hence, aborts the setting up of the said path by the 

15 signaling protocol. Thus by setting the value of this other 
further attribute to the predefined value according to the 
invention, the length of the attribute will not exceed the 
threshold length, and hence, will not be aborted by the 
signaling protocol. 

20 

[0033] According to another aspect of the invention, a method 
for storing data in a computer network comprising a plurality 
of nodes is provided, wherein each node comprises at least 
one connection oriented link layer unit, the method 

25 comprising the steps of identifying a looping path in the 

computer network comprising a plurality of computer nodes by 
the connection oriented link layer unit, and injecting data 
into the identified looping path at the computer node, in 
which looping path the injected data is to be circulated in, 

30 thereby storing the data in the computer network. 
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[0034] This aspect of the invention relates to storing data 
in a looping path created in the computer network. The 
looping path available for storing data is first identified 
by the COLL unit according to the invention. In this case, a 
further attribute in the connection unit at each node of the 
looping path may be used to contain a value which uniquely 
identifies a specific looping path from a plurality of 
looping paths for data storage. 

[0035] When a specific looping path to be used for storing 
data is identified, data to be stored is then injected into 
the identified looping path by the COLL unit of the computer 
node . 

[0036] The COLL unit according to a preferred embodiment of 
the invention is implemented according to a generalized MPLS 
specification. The advantages of using the generalized MPLS 
specification are already described above. It should also be 
noted again that it is possible to implement the COLL unit 
according to other protocols such as ATM or Frame-relay. 

[0037] The injection of data in the identified looping path 
according to the invention further comprises the steps of 
affixing a header, in particular a network header, to each 
data packet of the data to be injected into the looping path 
at a computer node, wherein the header is associated with the 
identified looping path, determining the forwarding path 
information of the header affixed to the data packet by the 
COLL unit at the computer node, and affixing a further COLL 
header by the COLL unit to the data packet affixed with the 
network header at the computer node, wherein the COLL header 
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comprises an outgoing label which maps the data packet into 
the identified looping path, thereby storing the data in the 
computer network. The network header which is affixed to the 
data packet is preferably a network-layer header. As the 
5 network-layer header contains information relating to the 

identification of the looping path, such information is used 
to differentiate data packets to be stored in the looping 
path according to the invention from the normal data packets 
to be transported through the computer network. 

10 

[0038] Depending on the implementation of the COLL unit, the 
COLL header may comprise a time to live (TTL) field having a 
value which is being decremented by the COLL unit at each 
computer node. Such a TTL field has a maximum value when it 
15 is first injected into the looping path. When the value of 
the TTL field decreases at each computer node and falls below 
a threshold value, the data packet which the COLL header is 
affixed to is discarded as the path taken by the data packet 
is assumed to be looping. 

20 

[0039] In a preferred embodiment of the invention, the value 
of the TTL field is set to a predefined value by the COLL 
unit at at least one computer node along the looping path. 
In this way, the value of the TTL field never falls below the 
25 threshold value, and hence the data packet is able to 

continue to circulate in the looping path indefinitely, or 
for a configurable amount of time. 

[0040] In the case of a typical transportation of a data 
30 packet in the computer network, the TTL field in the network 
header of the packet is initialized based on the TTL field of 

13 
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the COLL header when the packet exits the LSP. However, when 
a data packet exits the looping LSP from a DIN node, that DIN 
node behaves as the source node for that data packet, and 
sets the network layer TTL field to the maximum value to 
5 allow it to be transported to a destination node in the 
network. 

[0041] It should be noted that this aspect of the preferred 
embodiment cannot be implemented using ATM protocols in the 
10 COLL unit as the COLL header in this case does not have any 
TTL field. 

[0042] The invention further provides a method for removing 
data stored in the looping path of the computer network, 

15 wherein the method comprises setting an administrative bit in 
a signaling message generated by the signaling protocol 
running on the computer nodes to a predefined value, and 
sending the signaling message to a computer node along the 
looping path, thereby setting an administrative attribute of 

20 the connection unit at the computer node and causing the 

computer node to remove the data stored in the looping path 
of the computer network. 

[0043] In this case, when the computer node receives the 
25 signaling message with the administrative bit set to the 
predefined value, the node updates the administrative 
attribute of its connection unit associated with the looping 
path. This causes any incoming data arriving at the computer 
node from that looping path to be removed, until the 
30 administrative attribute of the connection unit is updated 
again . 
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[0044] It should be noted that the setting of the 
administrative attribute of the connection unit for removing 
data stored in the looping may be achieved through a 
programmatic interface provided at the computer node instead 
of using signaling messages. 

[0045] The invention also further provides a method for 
reading data stored in the looping path of the computer 
network, the method comprises sending an experimental message 
generated by the signaling protocol running on the computer 
nodes of the computer network to a computer node along the 
looping path, thereby setting a duplicate attribute of the 
connection unit at that computer node and causing the 
computer node to duplicate the data stored in the looping 
path of the computer network. 

[0046] The method described in this case allows data stored 
in the looping path of the computer network to be read by a 
computer node. Since data in the looping path has no final 
destination but circulates in the looping path, a computer 
node which wants to read the stored data has to duplicate the 
data into a buffer, and also has to forward the data to the 
next node along the looping path to let it continue to 
circulate in the looping path. 

[0047] An experimental message generated by the signaling 
protocol is sent to the computer node where duplication is to 
be performed. The computer node on receiving the 
experimental message sets the duplicate attribute of its 
connection unit associated with the looping path, so that any 
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incoming data from the looping path arriving at the computer 
node are duplicated. In addition, a further attribute may be 
attached to the duplicate attribute of the connection unit 
associated with the looping path, so that duplicated data may 
be delivered using normal data transport paths to the 
application requesting the data 

[0048] It should again be noted that the setting of the 
duplicate attribute of the connection unit for duplicating 
data stored in the looping path may be achieved through a 
programmatic interface provided at the computer node instead 
of using signaling messages. 

[0049] The invention also provides a system for enabling 
storage of data in a computer network comprising a plurality 
of computer nodes, wherein each computer node comprises at 
least one connection oriented link layer unit, the system 
comprising a definition unit for defining a looping path in 
the computer network, wherein the looping path comprises a 
plurality of computer nodes and connections between the 
computer nodes, and a configuration unit for configuring a 
connection unit at each node along the looping path, the 
connection unit being supported by the connection oriented 
link layer unit, such that the connection oriented link layer 
unit at each computer node is able to send incoming data 
which is to be stored in the computer network to a next 
computer node along the looping path based on the connection 
unit, thereby providing the looping path for data to be 
circulated in, and thereby enabling the storage of data in 
the computer network. 
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[0050] In a preferred embodiment of the invention, optical 
fibers are used as the connections between the computer nodes 
in the computer network. The advent of Dense Wavelength 
Division Multiplexing (DWDM) technique has caused the 
5 bandwidth of optical fibers to increase tremendously, 

reaching a current capacity of about 1.6 Terabits per second. 
Each optical fiber is able to carry multiple wavelengths 
which can be processed individually by computer nodes, in 
particular photonic nodes. Therefore, at least one 
10 wavelength can be used to create loops for storing data 

without significantly affecting the overall bandwidth of the 
computer network comprising optical fibers. 

[0051] Another advantage of using optical fibers is that data 
15 in the fibers travels at about 0.66 times the speed of light. 
Therefore, data which is stored in the looping path contained 
in optical fibers according to the invention can be delivered 
to nodes requesting them almost instantaneously even when the 
nodes are thousands of kilometers away. 

20 

[0052] It should however be noted that the connections 
between the computer nodes are not limited to optical fibers, 
but may also be implemented using other connection means, for 
example, Ethernet cables, Radio Frequency connections, etc. 

25 

[0053] A system according to the invention is also provided 
for storing data in a computer network comprising a plurality 
of computer nodes, wherein each computer node comprises at 
least one connection oriented link layer unit, the system 
30 comprises an identification unit for identifying a looping 
path in the computer network comprising a plurality of 
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computer nodes by the connection oriented link layer unit of 
a computer node; and an injection unit for injecting data 
into the identified looping path at the computer node, in 
which looping path the injected data is to be circulated in, 
thereby storing the data in the computer network. 

[0054] The system further comprises a removal unit at at 
least one computer node for removing the data stored in the 
identified looping path when an administrative attribute of a 
connection unit at the computer node is set, thereby causing 
the computer node to remove the data stored in the looping 
path. 

[0055] The system also further comprises a retrieval unit at 
at least one computer node for duplicating the data stored in 
the identified looping path when a duplicate attribute of the 
connection unit at the computer node is set, thereby causing 
the computer node to retrieve the data stored in the looping 
path. It should be noted that the retrieval unit allows the 
data stored in the looping path to be read at the computer 
node without removing the data from the looping path. The 
retrieved data can further be delivered to another computer 
node requesting the data. 

Brief Description of the Figures 

[0056] Figure 1 shows how data packets are transmitted inside 
an optical fiber. 

[0057] Figure 2 shows an implementation of a created looping 
path on a computer network according to the invention. 
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[0058] Figure 3 shows the Explicit Route (ER) TLV of the 
Label Request/Mapping Message of the LDP signaling protocol. 

[0059] Figure 4 shows the Explicit Route Hop (ER HOP) TLV of 
the Label Request/Mapping Message of the LDP signaling 
protocol . 

[0060] Figure 5 shows the Looping LSP TLV of the Label 
Request/Mapping Message of the LDP signaling protocol. 

[0061] Figure 6 shows how data packets are sent to the 
looping path created according to the invention. 

[0062] Figure 7 shows the Admin Status TLV of the Label 
Request/Mapping Message of the LDP signaling protocol. 

[0063] Figure 8 shows the Action Message of the LDP signaling 
protocol . 

[0064] Figure 9 shows the LSP ID TLV of the Action Message. 

Detailed Descri ption of preferred embodiments of the 
invention 

[0065] A computer network in very general term comprises a 
plurality of computers which are linked together to allow 
exchange of information among them. 

[0066] A Local Area Network (LAN) is a group of computers 
which are connected together in a localized area. It 
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generally comprises personal computers, printers, servers and 
other devices and allows sharing of resources by devices 
connected to the LAN. 

[0067] A Wide Area Network (WAN) covers a large geographical 
area and often uses physical transmission lines like optical 
fiber, telephone lines, etc. Service Providers (SP) may 
allow one or more LANs to be connected to the WAN using 
routers, giving rise to the computer network allowing 
transportation of data from one computer to another. 

[0068] The computer network in this case comprises routers at 
the interface between the LAN and WAN, computers in the LAN, 
switches in the WAN, hubs, servers or any programmable 
devices. These devices at various junctions of the computer 
network are known as computer nodes. 

[0069] The Open System Interconnection (OSI) reference model 
developed by the International Organization for 
Standardization (ISO) describes how information is 
transmitted from one computer node to another computer node 
through the physical network connections. The OSI model is 
now the standard communication architecture model for a 
computer node of a computer network, and is described briefly 
here. The detailed description of the OSI reference model is 
easily available in networking literature. 

[0070] The OSI model has seven layers (known as OSI layers) : 
Layer 1 to Layer 7. Layer 1 is the physical layer which is 
concerned with transmitting raw data bits over a 
communication channel. Layer 2 is the data link layer which 
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provides a reliable transmission of data across the physical 
layer. Layer 3 is the network layer which controls the 
operation of the network. Layer 4 is the transport layer 
which accepts data from the Layer 5 and segments it for the 
network layer (Layer 3) to be transmitted. Layer 5 is the 
session layer which manages communication sessions between 
computer nodes. Layer 6 is the presentation layer which is 
concerned with coding and conversion functions for the Layer 
7 data. Layer 7 is the application layer which interacts 
directly with a user software/interface. 

[0071] In this specification, we divide the OSI layers into 
two portions: the communication layers and the data 
forwarding layers. The communication layers is generally 
used to refer to user end application (layers 4 to 7) . The 
data forwarding layers is generally used to refer to the 
transportation of data in the network (layers 1 to 3) . 

[0072] The use of optical fibers for data transmission 
between computer nodes in a computer network has gained 
popularity due to the large amount of information a single 
optical fiber can carry. The ability to transmit data 
simultaneously at different wavelength of light in a single 
strand of optical fiber, a concept known as Dense Wavelength 
Division Multiplexing (DWDM), further increases the bandwidth 
of the fiber. This makes optical fiber an ideal choice to 
cater for the large volume of data traffic in the computer 
network like the internet. 

[0073] Fig.l shows an exploded view of a portion of an 
optical fiber bundle 100. The fiber bundle 100 comprises a 
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plurality of optical fibers 101, wherein data are transmitted 
inside each of these optical fibers 101. 

[0074] In a computer network, data packets 104 are 
multiplexed into data streams 103. The multiplexed data 
streams 103 are then transmitted in optical fibers 101, 
wherein each optical fiber 101 comprises a plurality of 
wavelengths 102 for transmitting several multiplexed data 
streams 103. The optical fibers 101 are bundled to form the 
optical fiber bundle 100 which is used to connect to other 
computer nodes which can be thousands of kilometers away. 

[0075] Fig. 2 shows a computer network 200 with possible 
looping paths created according to the invention. The 
computer network 200 comprises a plurality of computer nodes 
201. Computers 202 are connected to the network or WAN 200 
using routers 203. 

[0076] Data packets 210 to be transmitted from a source 
computer 202 to a destination computer 202 are first injected 
into the network 200 through an ingress node 201. The data 
packets 210 are then transmitted to the destination computer 
along a path through the nodes 201. The transmitting of the 
data packets 210 in the network 200 is accomplished by 
forwarding each data packet 210 at each node 201 along a 
forwarding path. At each node 201, the content of the packet 
header is read and the data packet 210 is forwarded to a next 
node 201 based on the content of the packet header. The next 
node 201 also reads the content of the data packet header and 
determines a further next node for the data packet 210 to be 
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forwarded to. The forwarding process continues until the 
data packet 210 is received by the destination computer 202. 

[0077] The forwarding path in the computer network is set up 
by configuring a connection unit at each of the computer 
nodes along the forwarding path. Each computer node should 
preferably have a programmatic interface which allows the 
settings of the connection unit to be configured. The 
settings of the connection unit may be configured using 
software or by an administrator. 

[0078] The connection unit comprises connection entities 
which may have, for example, the form of <port, logical 
identifier, directions The port defines the physical port 
on the computer node, at/from which data is received/sent, 
logical identifier is a locally-scoped identifier to identify 
a switched path, and the direction defines whether the 
connection entity is an incoming or an outgoing entity. 
Using the connection unit, a pair of connection entities on a 
computer node can be created such that an incoming connection 
from a previous node connects to an outgoing connection to a 
next node along a forwarding path. 

[0079] By establishing a series of connection entities on a 
plurality of computer nodes, a looping path that begins and 
ends on the same computer node can be defined. For example, 
a path may begin at an initial node I. On this node I an 
outgoing connection entity <X, ID 30, OUT> is created. The 
path may end at an end node E such that it has an incoming 
connection entity <Y, ID 40, IN>. Nodes I and E need not be 
adjacent, but are connected by a switched path passing 
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through none or at least one node at which the appropriate 
connection entities have been configured such that the 
switched path begins at Node I: <X, 30, OUT> and ends at Node 
E: <Y, 40, IN>. To establish a looping path between I and E, 
an outgoing connection entity on Node E and an incoming 
connection entity on Node I can be added such that <Y, ID 40, 
IN> on Node E is connected to <X, ID 30, OUT> on Node I. 

[0080] The configuration of the connection unit, in 
particular the connection entities, is set by a signaling 
message generated by a signaling protocol running on each of 
the computer nodes of the computer network. 

[0081] However, it should be noted that the configuration of 
the connection unit can also be set by the administrator at 
every node along the looping path in an alternative 
embodiment . 

[0082] The path which is set up in the computer network is 
generally referred to as a Label Switched Path (LSP) . With a 
looping LSP set up, any computers connected to the network, 
subject to the administrative permissions, are able to store 
and access data in this created looping path. 

[0083] According to the invention, a method is provided for 
enabling data to be stored in a computer network by creating 
a looping path through a plurality of nodes, so that data 
packets can be made to loop in the created looping path 
instead of being transmitted to a destination node. In other 
words, data are said to "persist" in the network, and the 
created looping path is called the "persistent path" (the 
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term "created looping path" and "persistent path" shall be 
used interchangeably henceforth) . 

[0084] The preferred embodiments of the invention will now be 
described in detail. 

[0085] A connection oriented link layer unit, such as one 
based on generalized Multi-Protocol Label Switching (MPLS), 
is implemented on the computer nodes of the computer network 
to control the forwarding of the data packets 210. The MPLS 
based control plane comprises both a routing framework and a 
signaling framework and also supports significant 
applications such as constrained-based routing as described 
in [9] . The routing framework runs routing protocol such as 
Open Shortest Path First (OSPF) or Intermediate Systems (IS- 
IS) to obtain information on the topology and resources of 
the network. The signaling framework runs signaling 
protocols such as Label-Distributed Protocol (LDP) or 
Resource Reservation Protocol (RSVP) to establish the 
forwarding paths based on the information obtained from the 
routing protocol and other constraints imposed by an 
administrator . 

[0086] In order for looping paths to be created and 
maintained in the network, modifications are made to the 
signaling protocols so that the created looping or persistent 
paths according to the invention can be differentiated from 
undesired looping paths, and only the persistent paths are 
prevented from being aborted by the signaling protocols. 
Furthermore, other parameter or persistent attributes of the 
persistent paths, like the bandwidth allocated for storing of 
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data in the looping paths or the time for the stored data to 
circulate in the looping path, can be configured. 

[0087] The invention is deployed on the network such as the 
5 one as shown in Fig. 2, but is not restricted to any topology 
(ring, mesh or star) . The COLL unit implemented on the nodes 
201 of the network 200 is preferably according to the 
generalized Multi-Protocol Label Switching (MPLS) 
specification. The nodes 201 may run additional protocols 
10 such as Link Management Protocol as described in [10] to 
comply with the generalized MPLS specification. 

[0088] In addition, signaling protocols should preferably 
support Traffic Engineering described in [11] and routing 
15 protocol should preferably implement Traffic Engineering 
extension to routing as described in [12] . 

[0089] In the generalized MPLS network, data packets 210 are 
forwarded based on labels affixed to the packet headers 
20 instead of reading the content of the packet headers. 

[0090] When the data packet 210 to be transmitted are sent to 
an ingress node, the content of each of the packet header is 
read and a label is affixed to the packet header. The data 

25 packet 210 and its packet header is then sent to a next node 
201 of the forwarding path together with the label. The next 
node 201 reads the label affixed to the data packet 210 (not 
the content of the packet header) and forwards the data 
packet 210 to another node 201 along the forwarding path. 

30 Thus, the data packet 210 is said to be "switched" by the 
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nodes, and the nodes are called "Packet Switching Capable" 
(PSC) nodes. 

[0091] It should be noted that although the nodes 201 are 
described to switch data packets, it is also possible for the 
generalized MPLS based network 200 to support nodes that are 
capable of switching data based on TDM, wavelengths (lambda) 
and entire fibers. When switching based on TDM is desired, 
TDM-capable nodes should be implemented as the network nodes 
201 instead of PSC nodes. Similarly, when switching based on 
wavelengths and entire fibers is desired, Lambda Switch 
Capable (LSC) nodes and Fiber Switch Capable (FSC) nodes 
should be implemented as the network nodes 201, respectively. 

[0092] At least one node 201 in the network 200 is to 
function as a Data-in-Network (DIN) node. The DIN node is a 
"modified" node which is capable of creating and managing the 
persistence attribute of the persistent path and the data 
stored therein. The DIN node is hence also able to read 
certain attributes associated with the looping path, and to 
modify the attributes, if necessary. The DIN node, which 
normally serves as an ingress or egress node for data in the 
persistent path, co-exists with other non-DIN nodes in the 
network 200. 

[0093] It should be noted that only one node along the 
persistent path is necessary to function as a DIN node, and 
the other nodes may be non-DIN nodes. However, for good 
performance and control processing of persistent paths that 
are very long, or have complex loops, a plurality of DIN 
nodes is preferably implemented in the network 200. 
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Creation and Management of the per sis tent /looping path 

[0094] The creation of the persistent path is initiated by a 
DIN node, known as the Loop Initiator, by generating a Label 
Request Message from a signaling protocol such as LDP. The 
Label Request Message is forwarded along a path wherein we 
desire to implement persistence, e.g. to store data therein. 

[0095] The path of the persistent path is defined in an 
Explicit Route attribute (ER TLV) of the Label Request 
Message. The ER TLV is an object that specifies the path of 
the persistent path and comprises one or more Explicit Route 
Hop TLVs (ER-HOP TLVs) as shown in Fig. 3. 

[0096] Each computer node along the persistent path is 
assigned a unique Label-Switch-Router ID (LSR ID) which 
identifies each node in the network. The path of the 
persistent path is defined in the ER TLV by setting the value 
of each ER-HOP TLV to a corresponding LSR ID. The ER-HOP TLV 
is shown in Fig. 4. 

[0097] The path is defined such that it starts and ends at 
the same node, preferably at the Loop Initiator. This is 
achieved by setting the value of the last ER-HOP TLV of the 
ER TLV as the LSR ID of the Loop Initiator. However, in 
another embodiment, the Loop Initiator may activate some 
other DIN nodes to cause a looping LSP to be setup, and the 
Loop Initiator may not lie in the path of this LSP. In any 
case, the node that originates the Label Request message will 
also be the last hop in the ER-HOP TLV. 
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[0098] Once the Label Request Message has reached the last 
node of the persistent path, a Label Mapping Message is 
generated by the last node of the persistent path (in this 
5 case is also the Loop Initiator) and follows the path of the 
persistent path in the reversed order to complete the 
signaling process of the persistent path. At this stage, 
each node along the path of the Label Mapping Message will 
configure the connection entities of its connection unit and 

10 also allocate necessary network resources for the persistent 
path according to network constraints specified by the 
administrator and/or attributes carried by the Label 
Request/Label Mapping Message itself. When the node 
originating the persistent path finally receives the Label 

15 Mapping message, it creates an outgoing connection entity at 
the connection unit and splices the outgoing connection 
entity to a corresponding previously setup incoming 
connection entity. Hence the loop is completed. The created 
persistent path is identified with a Label Switch Path (LSP) 

20 ID being assigned to it. 

[0099] In the signaling process of creating the persistent 
path, an experimental TLV of the Label Request Message and/or 
the Label Mapping Message is used to identify the persistent 

25 path so that each DIN node along the persistent path on 

reading this attribute will update its persistence bit in the 
connection unit, such that data in this path is treated 
differently. The experimental TLV comprises an Unknown TLV 
bit, a Forward Unknown TLV bit, a Looping LSP TLV type field, 

30 a Length field and a Value field as shown in Fig. 5. 
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[0100] The Unknown TLV bit and the Forward Unknown TLV bit 
are set to "1". According to the MPLS signaling 
specifications, non-DIN nodes are not able to interpret the 
experimental TLV and will pass the value of the experimental 
5 TLV to a next node unchanged. The DIN nodes on receiving the 
Label Request/Mapping Message with the Looping LSP TLV set 
will perform signaling protocol modifications as described 
below. 

10 Modifications to Loop Detection Mechanisms in Signaling 
Protocol 

[0101] Loops in network are generally undesirable as they use 
up valuable network bandwidth resources required for data 
15 transmission resulting in wastage of the bandwidth resources. 
Therefore, signaling protocols running in most networks have 
loop detection mechanisms for detecting such undesirable 
loops and aborting them. 

20 [0102] Loop detection is a configurable option in the 

signaling protocol, such as LDP or RSVP, running in the MPLS 
based network. The loop detection option has to be turned 
"on" at all the nodes in the network in order for loop- 
detection mechanism to function correctly. The method 

25 according to the invention enables creation of looping paths 
which can be differentiated from the undesired looping paths, 
so that only the undesired looping paths are detected and 
aborted by the loop detection mechanisms. 

30 [0103] Modifications to the signaling protocol are performed 
at at least one DIN node along the persistent path created 
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according to the invention. The modifications to the 
signaling protocol are to prevent the loop detection 
mechanism of the signaling protocol from detecting the 
persistent path and aborting it. 

[0104] Two attributes in the Label Request Message and the 
Label Mapping Message of the LDP signaling protocol are used 
for detection of looping paths in the network. 

[0105] A first attribute, HOP COUNT TLV, has a value which is 
incremented at every node along a path in the network. When 
the value of the HOP COUNT TLV exceeds a certain threshold 
value, the path signaled by the Label Request/Mapping Message 
is deemed to be looping. The node which detected the 
exceeded HOP COUNT TLV value sends a status signal to the 
source of the Label Request/Mapping Message, and aborts the 
signaling of the path. 

[0106] According to the invention, the value of the HOP COUNT 
TLV is reset to a value of "1" at at least one DIN node along 
the persistent path. In this way, the value of the HOP COUNT 
TLV will not exceed the threshold value, and hence the 
signaling of the persistent path will not be aborted by the 
signaling protocol. 

[0107] At every node along the path signaled by the signaling 
protocol, identifier of each corresponding node (LSR ID) is 
added to a second attribute of the Label Request/Mapping 
Message, which is the PATH VECTOR TLV. When the PATH VECTOR 
TLV becomes too long and exceeds a threshold length, the path 
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is assumed to be looping and hence, the signaling of the path 
is aborted. 

[0108] According to the invention, all intermediate node 
identifiers in the PATH VECTOR TLV are removed at at least 
one DIN node along the persistent path, and substituted with 
the identifier of that DIN node. This is to prevent the PATH 
VECTOR TLV from becoming too long and as a result, the 
corresponding path being interpreted as a looping path. In 
addition, this also prevents other nodes from detecting their 
own node identifiers in the PATH VECTOR TLV, which is also an 
indication that the path is looping. 

[0109] It should be noted that although the modification of 
the attributes described above relates to the LDP signaling 
protocol, such modifications can also be implemented in other 
signaling protocols like RSVP. 

[0110] Specifically, a Path Message of the RSVP signaling 
protocol carries a L ABE L_RE QUEST object for creating a path 
in the network. An optional object, which is the 
RECORD_ROUTE object, in the Path Message has similar behavior 
as the PATH VECTOR TLV of the Label Request/Mapping Message 
of the LDP Signaling protocol and is used for loop detection. 
In the same manner, the modifications with regard to the PATH 
VECTOR TLV attribute can be implemented on the RECORD_ROUTE 
object to prevent a desired persistent path from being 
detected and aborted by the RSVP signaling protocol. 
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Management of data in the Persistent Path 

[0111] DIN nodes according to the invention classify data 
packets into those to be injected into the created persistent 
5 path for storage and those to be transported to one or more 
destination nodes in the network. Such packet classification 
of data can be implemented in several ways. 

[0112] One embodiment of packet classification is shown in 
10 Fig. 6. An application that wants to send data packets 305 to 
be stored in the persistent path first sends the data packets 
to a Loop Controller 301 which is implemented using one DIN 
node. The Loop Controller 301 affixes a network or 
application layer header to the data packets 305, wherein the 
15 network/application layer header maps the data packets to one 
persistent path. 

[0113] The information on the availability of the persistent 
path is obtained from a distributed Loop Information Base 
20 302, which in turn obtains its information from a Loop 
Manager node 303. The Loop Manager 303 manages all the 
persistent paths in the network based on information obtained 
from the routing framework and other constraints imposed by 
administrators . 

25 

[0114] Data packets 305 having network/application-layer 
header field are affixed further with a MPLS header at the 
DIN node, wherein the MPLS header comprises an outgoing label 
which maps the data packet to the persistent path. The data 
30 packets 305 are subsequently forwarded to the persistent path 
306 and persisted therein, as the nodes along the path 
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perform simple forwarding based on the label on each of the 
data packets 305. 

[0115] In another embodiment of the invention, data packets 
classification is based on Internet Protocol (IP) addresses. 
Data packets desired to be stored in a persistent path in the 
network are affixed with an IP address having a destination 
belonging to a subset of a private IP address space. This 
affixing of a new IP destination header is done by a DIN 
node . 

[0116] In this case, the data packets are sent by an 
application/node to an appropriate DIN node having a 
"Write/Inject" service. The DIN node reads the header of 
each of the data packets, and/or other parameters sent by a 
requesting application/node, and affixes a new network layer 
header such that the packet now has a destination in the 
private IP address space. Each of the data packets with the 
affixed network layer header is then routed out through an IP 
interface of the DIN node, and is stored in the associated 
persistent path. 

[0117] The IP interface which is also an outgoing interface 
for that data packet at the DIN node could be an MPLS tunnel 
interface. However, the IP interface is only the outgoing 
interface for the said private IP address space according to 
the DIN node's routing table In addition, the destination IP 
address is also bound to an outgoing MPLS label which is 
obtained based on Forwarding Equivalence Class (FEC) to Next 
Hop Label Forwarding Entry (NHLFE) (FTN) mapping. This 
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mapping is created at each DIN node during the creation 
process of the switched path. 

[0118] Thus the data packets are affixed with the outgoing 
label by looking up the FTN map for the DIN node. This is 
done by the COLL unit of the DIN node. The data packets are 
finally sent out via associated physical network interface 
into the persistent path. In this case, the DIN node 
functions as the ingress node. 

[0119] In both of the above embodiments, the injected data 
packets follow the path of the persistent path and will 
return to the ingress node. However, now the data packets 
would each have an incoming label affixed to them, and the 
ingress node functions as a normal switching node and uses an 
Incoming Label Map to switch the data packets to the next hop 
in the persistent path. Therefore, the data packets are 
circulated and hence, stored in the persistent path. 

[0120] In the MPLS network, MPLS data packet headers contains 
a Time-to-Live (TTL) field. This TTL field is always set to 
a maximum value at the ingress node and is decremented at 
every node along its path in the network. When the value of 
the TTL field is decremented to "0" at a node, the 
corresponding data packet will be discarded by that node. 
Hence the TTL field in the MPLS data packet header is also 
used as a "looping packet detection" mechanism in the network 
in addition to the loop detection mechanisms in the signaling 
framework. 
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[0121] In order for the data packets in the persistent path 
to have an indefinite life time and not be discarded, the 
value of the TTL field of the header of the data packets is 
reset to the maximum value at at least one of the DIN nodes 
5 along the persistent path. 

[0122] This can be accomplished, for example, by the ingress 
node of the data packets in the persistent path. In this 
case, when the DIN ingress node generates the outgoing label 

10 to the persistent path, a "looping LSP" flag can be set in an 
Incoming Label Map entry (an attribute in the connection 
unit) for that persistent path or outgoing label. By setting 
this flag, the ingress node, which is path of the persistent 
path, will then process the forwarding header of data packets 

15 in the persistent path differently by resetting the TTL field 
to its maximum value. 

[0123] It should be noted that the mechanism for resetting 
the value of the TTL field are only in relation to PSC nodes. 

20 In non-PSC nodes, there is no packet header processing and 
hence, TTL field are not processed. However, the system 
allows any specific method, such as regeneration of the input 
optical signal, to be applied instead. Therefore, data in the 
persistent path will persist until other events signal the 

25 deletion of the persistent path or its content. 

[0124] The persistent paths created according to the 
invention have infinite lifetime, unless the path is signaled 
to be deleted. The content of the persistent path can be 
30 modified or cleared without having to delete the persistent 
path. 
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[0125] A mechanism in the generalized MPLS, called the 
Administrative Status Information, is used for removing the 
contents of the persistent path. The Administrative Status 
5 Information is carried in an Admin Status Object in the Label 
Request/Mapping Message as shown in Fig. 7. Therefore when 
the Label Request/Label Message having the Admin Status 
Object is received by a DIN node of the persistent path, the 
DIN node updates its local LSP state table (or connection 
10 unit) by setting the persistent path to be administratively 
"down". As a result, any data packets arriving at that DIN 
node on the "downed" persistent path are dropped, until an 
Admin Status Object associated with the persistent path 
causes it to be administratively "up" again. 

15 

[0126] When an application wants to read the content of the 
persistent path, a DIN node duplicates the relevant content 
in the persistent path into a buffer, and sends the 
duplicated data to the application. The DIN node should also 
20 continue to forward the data packets in the persistent path 
so that the data packets continue to persist in the path. 
Thus the DIN node implements a non-destructive read feature. 

[0127] The request for duplicating the content of the 
25 persistent path is triggered by a new experimental message 
which can be generated by a computer node running the 
signaling protocol. The experimental message is known as an 
Action Message as shown in Fig. 8. The experimental message 
comprises a U bit, a Msg Type, a Message Length, a Message 
30 ID, a Vendor ID, Remaining Mandatory parameters and Optional 
parameters . 
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[0128] The U bit is an Unknown message bit. Upon receipt of 
an unknown message, a notification is returned to the source 
of the experimental message if U bit is clear ("0") . If U 
5 bit is set ("1") , the unknown message is ignored. The Msg 
Type has a range between 0x3F00 and 0x3FFF. A Msg Type, for 
example 0x3F01, may be uniformly interpreted by all DIN nodes 
as a Action Message. The Msg Type and the Vendor ID specify 
how the message is to be interpreted. The Message Length 
10 specifies the cumulative length in octets of the Message ID, 
Vendor ID, Remaining Mandatory parameters and the Optional 
parameters. A LSP ID TLV is one of the remaining mandatory 
parameters that specifies on which switched persistent path 
the duplication action is to be performed. 

15 

[0129] The LSP ID TLV is a mandatory parameter for the Label 
Request Message, and is used to uniquely identify an LSP 
within the generalized MPLS network. When a message to 
duplicate the contents of a looping LSP is received by a DIN 
20 node, the message must also have an attribute to identify the 
LSP whose contents have to be duplicated. In this case, the 
attribute for identifying the said LSP for data duplication 
is provided by the LSP ID TLV. The LSP ID TLV of the Action 
Message is shown in' Figure 9. 

25 

[0130] The Message ID is a 32-bit integer which is set to 
0x0001 to identify the experimental message. The Message ID 
is used by the LSR to facilitate the identification of 
notification messages that may apply to this message. The 
30 Vendor ID is not applicable in this case. The Remaining 

Mandatory and Optional parameters are variable length set of 
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remaining required message parameters and optional message 
parameters, respectively. This experimental Action Message is 
understood by all the DIN nodes. 

5 [0131] The Action Message is sent explicitly to a target DIN 
node where duplication of the content of the persistent path 
is desired. Upon receipt of the Action Message by the target 
node, the target node sets a "duplicate" bit in its local LSP 
state table (or connection unit) for the said persistent 
10 path. As a result, every incoming data packet arriving at 
the target node from the persistent path is duplicated. 

[0132] In addition, a forwarding action may be attached to 
the persistent path in the LSP state table of the target 
15 node, so that the duplicated data packets can be channeled 
into another path in the network to be transported to a 
requesting node using the normal transportation function of 
the computer network. 

20 [0133] The duplicated data packets can also be delivered to 
the requesting node by giving them a valid network layer 
header. In this case, the delivery mechanism uses the same 
network as a transport pipe. 

25 [0134] While the embodiments of the invention have been 

described, they are merely illustrative of the principles of 
the invention. Other embodiments and configurations may be 
devised without departing from the spirit of the invention 
and the scope of the appended claims . 

30 
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